Cloud Engineer (Databricks) | Contract

As a Databricks SME, you will be responsible for providing expert guidance and support in the implementation and optimization of Databricks solutions. You will work closely with cross-functional teams to design, develop, and deploy data pipelines and analytics solutions that meet business needs.

Key Responsibilities:

• Serve as the primary expert on Databricks, providing technical guidance and support to teams.
• Design and implement data pipelines using Databricks and Apache Spark.
• Collaborate with data engineers, data scientists, and business stakeholders to understand data requirements and deliver solutions.
• Optimize existing Databricks workflows for performance and efficiency.
• Conduct training sessions and workshops to enhance team knowledge of Databricks.
• Stay updated on the latest Databricks features and best practices, and share insights with the team.
• Troubleshoot and resolve issues related to Databricks environments and workflows.

Job requirement

• Bachelor’s degree in Computer Science, Data Science, or a related field.
• Proven experience with Databricks and Apache Spark.
• Around 4 - 5 years’ experience in datalake solutions
• Excellent programming skills such as Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and attention to detail.
• Excellent communication and collaboration skills.
• Databricks certification is a plus.
• Experience with cloud platforms (AWS, Azure, GCP).
• Familiarity with machine learning frameworks and tools.